Eigenmode analysis of the susceptibility matrix of the four-dimensional 
Edwards— Anderson spin-glass model 
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The nature of spin-glass phase of the four-dimensional Edwards- Anderson Ising model is numeri- 
cally studied by eigenmode analysis of the susceptibility matrix up to the lattice size 10 4 . Unlike the 
preceding results on smaller lattices, our result suggests that there exist multiple extensive eigenval- 
ues of the matrix, which does not contradict replica-symmetry-breaking scenarios. The sensitivity of 
the eigenmodes with respect to a temperature change is examined using finite-size-scaling analysis 
and an evidence of anomalous sensitivity is found. A computational advantage of dual formulation 
of the eigenmode analysis in the study of large lattices is also discussed. 
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An essential problem in the study of randomly frus- 
trated systems such as spin glass (SG) is how to choose 
appropriate order parameters. In these systems, most 
fluctuating variables depend on both of the sample and 
the temperature used in an experiment. A traditional 
way to analyze such systems is introduction of order pa- 
rameters defined by replica overlap. [[l| |J. 

An alternative method |?| 0), which is more natural 
and direct, is to choose a set of bases adaptive to a 
given sample and temperature. Then, order parameters 
are defined as projections to them. This approach are 
also useful for the analysis of Monte Carlo (MC) simu- 
lation ||. Recently, Sinova et al. || Q pointed out a 
relation between the behavior of eigenvalues of the sus- 
ceptibility matrix with the increase of system size and 
the existence of replica symmetry breaking (RSB) ^ ||, 
which refreshed the interest in this approach. They ar- 
gue that RSB corresponds to the existence of multiple 
extensive eigenvalues in the thermodynamic limit, while 
the droplet picture Q implies the uniqueness of the ex- 
tensive eigenvalue. Sinova et al. numerically investigated 
the eigenmodes of the Gaussian Edwards- Anderson (EA) 
Ising model in four dimensions, for which the existence 
of RSB is most controversial, and obtained an evidence 
against the RSB picture. 

Although their approach is an attractive one, their 
study is limited to relatively small size < 6 4 (=1296) of 
the system. In the present letter, we extend the analysis 
to much larger size 10 4 (=10000) and to provide further 
tests for the RSB scenario. Our results show that the 
scaling of the second eigenvalue looks different in the re- 
gion of larger system size > 8 4 at the temperature region 
that Sinova et al. studied. It no longer contradicts the 
RSB picture. 

We also argue that there are no reason to restrict our- 
selves in the analysis of eigenvalues. Information con- 
tained in eigenmodes themselves, which are discarded 



in H [?]] , are also useful when we consider gauge invariant 
quantities defined by them. As an example, we discuss 
temperature dependence of the eigenmodes as a measure 
of fragility of the SG equilibrium states. An evidence of 
anomalous sensitivity in the SG phase is obtained by a 
finite-size-scaling analysis. 

Let us begin with the definition of the model. The 
four-dimensional EA model is defined with energy 



H(S) 



(ij) 



ij Si Sj , 



(1) 



where the Ising spins {Si} are defined on a hyper-cubic 
lattice in four dimensions with the total number N = L 4 
of sites. The strength {Jij} of nearest-neighbor interac- 
tions is distributed according to the bimodal distribution 
with equal weights at Jy = ±J. A SG phase transi- 
tion in this model has been well-established by numerical 
works. In particular, recent extensive MC studies have 
estimated the critical temperature T c to be 2.0 J |l(^, p"T| . 
The value of stiffness exponent 6 ~ 0.7 [[ll], [l2| in four 
dimension is significantly larger than that in three dimen- 
sions, 6*3D ^0.2 Jb|, which makes the study of asymp- 
totic behavior considerably easier. 

The susceptibility matrix of the model is written as a 
covariance form 



Ca = (SiSj) - (SMSj), 



(2) 



where the bracket denotes the thermal average. When 
we perform a MC simulation for the model, it can be 
approximated by Cy = jj ^ j X^X^, where X? is 

defined as S? — l/J^Eu=i &i an d is the value of a 
spin i (i = 1 . . . N) in a snapshot \i (/i = 1 . . . M). Then, 
in principle, diagonalization of Cy gives eigenvalues and 
the corresponding eigenvectors of Cy . In the high tem- 
perature limit, the matrix Cy is equivalent to the inter- 
action matrix J^, which is sparse in short-range models, 



2 



but it can be a dense matrix at lower temperatures. An 
efficient method for the eigenmode analysis used in this 
study will be explained at the end of the paper. 

In this study, we use the exchange MC method 
which enables equilibration of the system at low temper- 
atures, even in the SG phase. We simulate 32 replicas of 
different values of temperature simultaneously with the 
use of the multi-spin coding, and try to exchange repli- 
cas at neighboring temperatures after each sweep with 
single-spin heat-bath flips. The lowest temperature of 
the replicas is 1.0J ~ 0.5T C , whereas the highest temper- 
ature is 5.0J ~ 2.5T C . The systems of sizes L = 4, 6, 8, 
and 10 are examined. For each value of L, the number of 
bond samples used is 800, 640, 464 and 372, respectively. 

In Fig. ||, we present the average of the largest eight 
eigenvalues Aave = [A] j scaled by the system size N with 
being an average over the quenched randomness 
Jij. The data for the largest scaled eigenvalue is almost 
independent of N, implying that the eigenvalue is exten- 
sive at T j J = 1.0. This is consistent with the assumption 
that the system is in the SG phase. We are mostly in- 
terested in whether the second eigenvalue is extensive or 
not. It is observed in Fig. |] that the second eigenvalue 
apparently follows algebraic decay up to L < 6, which 
is consistent with the results of Sinova et al. || [?]]. The 
value of the slope in L < 6 in the double-log plot is also 
consistent with 8/d expected from the droplet picture ||, 
when we use the value of 9/d estimated in the previous 
studies 1 11, [T^ ]. However, the behavior of the second 
eigenvalue changes around L — 8 and has a tendency to 
saturate to a certain value in 8 < L < 10. Essentially, 
the same behavior is observed for the typical averaged 
value, Atyp = ln[expA]j. These observations show that 
the second eigenvalue is also extensive in the SG phase. 
That is, more than one eigenvalue is extensive. Accord- 
ing to the interpretation by Sinova et al. || [?| , our results 
do not contradict the RSB picture. 

Note that our findings of the multiple extensive eigen- 
values will also be compatible with a recently pro- 
posed sponge-like excitation picture [lf| (KMPY pic- 
ture), which argues that there appear to be large-scale 
low-energy excitations with the fractal dimension d s less 
than the bulk dimension d. Since the energy of such an 
excitation is supposed not to increase with the system 
size, we expect that it gives an additional extensive eigen- 
value of the susceptibility matrix. The standard RSB 
and the KMPY pictures can only be distinguished by 
the fractal nature of low-lying excitations. 

How our results are affected by the critical fluctua- 
tion? One conventionally uses the overlap distribution 
function P(q) to test the RSB picture in short-range SG 
systems pi 0, HG, 16 . A non-zero limiting value of P(q) 



at q ~ in the thermodynamic limit is considered as 
an evidence of the RSB phase. According to the droplet 
picture, P(q) at all q except for the self-overlap decreases 
with increasing L like L~ e . On the other hand, at the 
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FIG. 1: Size dependence of the first eight eigenvalues of the 
susceptibility matrix in the four-dimensional EA Ising model 
at T/J = 1.0. The dotted line has the slope 8/d ~ 0.24. 



critical temperature, P{q = 0) increases with L as L< 3 / v 
where p and v are the critical indices. These contribu- 
tions, whose signs are opposite, can apparently cancel out 
for moderate system sizes and give a plateau misidenti- 
fied as a convergence of P(0) to a non-zero constant [^7| . 
Such cancellation would not be expected in the present 
approach, because both effects make the scaled eigen- 
values Xi/N of the susceptibility matrix decrease with 
L. Thus, there are no chance of the cancellation even in 
the critical regions. We have confirmed that a few largest 
eigenvalues algebraically decay in L near the critical tem- 
perature, as expected. Meanwhile, we see no significant 
decrease of Aave/A in Fig. [I], which convinces us that 
T/J = 1.0 is already outside the critical region. 

So far we focus our attention on the eigenvalues of 
the susceptibility matrix. Useful information is, however, 
also contained in the eigenmodes. Here, as an example, 
we propose the use of temperature dependence of the 
eigenmodes as a measure of the sensitivity of the ther- 
modynamic states with respect to a temperature change. 
The overlap between eigenmodes with two different tem- 
peratures To and Tq + AT is defined by the scalar product 
of eigenvectors of the susceptibility matrix 



r(AT,L) 



l^ ei (T ,L)e 4 (T + AT,L) 



(3) 



where ei(T,L) denotes ith component of the eigenvector 
with the largest eigenvalue. We normalize the length of 
the eigenvectors to the unity. With this definition, the 
overlap r(AT, L) is equal to unity when the temperature 
difference AT is zero. In the inset of Fig. || we present 
r(AT,L) calculated with Tq/J = 1.0. For a given tem- 
perature difference AT, the overlap r(AT, L) decreases 
with increasing size L. We examine an one-parameter 
scaling r(AT, L) = R(L/ AT^ 1 ^) for the overlap. As 
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FIG. 2: A scaling plot of the first eigenmode overlap between 
T — Tq — 1.0 J and To + AT against the scaling variable 
LAT 1/C where C = 1.3(1). The curve represents a fit to the 
form r(AT, L) = 1 - CL C AT |5J with C ~ 0.02. The inset 
presents raw data as a function of temperature difference AT 
with different sizes. 



shown in Fig. 0, all the data merges into a universal scal- 
ing function, which is a monotonically decreasing with 
the increase of the scaling variable LAT 1 ^. The re- 
sult implies that a pair of eigenmodes with the largest 
eigenvalue at infmitesimally different temperatures are 
not correlated with each other in the thermodynamic 
limit, that is, extreme sensitivity to a temperature per- 
turbation. This peculiar feature never occur in a simple 
ferromagnet where the largest eigenmode always corre- 
sponds to the uniform state. It reminds us of "chaotic 
nature" of equilibrium SG states fl8l,|isj]. It is interesting 
to point out that the scaling exponent £ defined above 
is close to the exponent of chaos associated with bond 
perturbation . Whether this coincidence is accidental 
or not is left for future studies. 

Let us give a comment on the numerical method for cal- 
culation of the eigenmodes, which relaxes the numerical 
difficulty of treating a covariance matrix of large dimen- 
sions. In this method, dual algorithm, we diagonalize a 
M x M matrix D defined by 



1 N 



the matrix D is singular and has at least M — N zero 
eigenvalues. With this relation, we can replace the diag- 
onalization of the covariance matrix C with that of the 
sample-overlap matrix D, which reduces the amount of 
computation when N > M . Both algorithms give the 
same results for the same set of samples within numeri- 
cal accuracy. We should use a sufficient large number M 
which gives a good approximation of the susceptibility 
matrix. In the present study, we have tested convergence 
of the eigenvalues with different values of M and have 
confirmed that the algorithm shows good convergence. 
The dual algorithm has been known in the field of mul- 
tivariate analysis and already used in simulation studies 
of proteins. In the field of spin glasses, however, it seems 
less known and used. While a dual plot for visualizing 
hierarchical structures of low-energy valleys is recently 
introduced by j25fl , they did not stress the advantage of 
the dual formulation as a tool for efficient computation. 

To summarize, we numerically explored the eigen- 
modes of the susceptibility matrix of the four- 
dimensional Edwards- Anderson Ising spin glass model. 
First, we studied the eigenvalues of systems larger than 
those investigated in the previous study and found a 
strong evidence that the second eigenvalue is extensive in 
the thermodynamic limit. This no longer conflicts with 
the RSB pictures. Secondly, we discuss the sensitivity 
of the normalized eigenmodes against temperature per- 
turbation and found extreme sensitivity to the variation 
of the temperature. Finally, we mention to a technique 
with the primal-dual relation used in this study, which 
will be useful for the study of large systems. 
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instead of diagonalizing the N x N matrix C. We de- 
note eigenvectors of the matrices C and D as {ej}^ 
and {e M }( m ), respectively, where n and m are the in- 
dices of eigenvectors. It is easy to show the following 
primal-dual relations: (1) Yli-^-i e i i s an eigenvector 
of D if it is not the null vector, and (2) £^ ATfe^ (m) is 

an eigenvector of C if it is not the null vector. Note that 
when N > M, the matrix C is singular and has at least 
N — M zero eigenvalues, and, conversely, when M > N, 
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